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ABSTRACT 

A novel approach is introduced to address the problem of existence of 
differentiable eigenvalues and eigenvectors for a general matrix which may 
have repeated eigenvalues. A method is shown using the singular value 
decomposition algorithm to compute the eigenspace which contains the 
differentiable eigenvectors for a general matrix associated with repeated 
eigenvalues. The solutions of eigenvalue and eigenvector derivatives for 
repeated eigenvalues are derived. Several examples are given to illustrate 
the validity of formulations developed in this paper. 
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NOMENCLATURE 


i-th eigenvalue, right and left eigenvector of matrix A 
right and left eigenvector subspaces of i-th eigenvalue 

collection of right and left eigenvectors of i-th eigenvalue 

i-th differentiable eigenvector of matrix A 

collection of differentiable left eigenvectors corresponding 
to i-th eigenvalue 

i-th eigenvalue, right and left eigenvector of the matri 
3 j A/3p j 

multiplicity of i-th eigenvalue 

right eigenvector space corresponding to the eigenvalue xj^ 


dimension of the i-th eigenvector space 


«(J) 

♦i 


of the matrix 


3 J A/3p J 

dimension of the intersection subspace between 



and S 


(j) 


number of differentiable eigenvectors for i-th eigenvalue 

coefficients corresponding to i-th eigenvector derivative 

scalar parameter of matrix A 
sub3pace intersection 

direct sum of linearly independent subspaces 



INTRODUCTION 


Current space structures may be dynamically very complex. Situations 
frequently arise in which vibration modes are very close together in 
frequency. This condition may occur, for example, when structures are 
nearly symmetric in a plane or when loosely coupled branch systems have 
natural frequencies which are very close to those of the global system. 
Prediction of the dynamic behavior of structures under these conditions is 
difficult. The phasing of branch responses relative to the parent structure 
may be entirely reversed in certain modes depending upon the accuracy of a 
crucial stiffness parameter. 

System performance or control stability may depend upon the ability to 
predict the structural behavior under these sensitive conditions. Thus 
understanding the sentitivity of the eigenvalues and eigenvectors with 
respect to some parameter such as a stiffness or mass value under conditions 
of close or repeated eigenvalues is essential. The eigenvalue and 
eigenvector derivatives for a matrix with distinct eigenvalues are well 
documented in references [1-4], The general expressions for eigenvalue and 
eigenvector derivatives for non-self-adjoint systems appear to be first 
given by Rogers [1], The formulation was correct but incomplete in the 
sense that only directional changes were included in the eigenvector 
sensitivity. Lim, et al [4], re-examined the eigenvector derivatives by 
including the contribution of eigenvector change in the nominal eigenvector 
direction. The existence of derivatives of eigenvalues and eigenvectors 
corresponding to a repeated eigenvalue, however, has not been addressed. 

The purpose of this paper is to discuss the existence and some 
computational aspects of the derivatives of eigenvalues and eigenvectors of 
a general matrix which may have repeated eigenvalues. The singular value 
decomposition algorithm is used to compute the basis for an eigenspace which 
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determine the differentiable eigenvectors associated with repeated 
eigenvalues. Examples are presented to illustrate the concepts. 

EXISTENCE OF THE EIGENVALUE AND EIGENVECTOR DERIVATIVES 

Consider the right eigenvalue problem 

A^i = A.iJk ( i = 1 n) or AH' ** YA (1) 

and the left eigenvalue problem 

♦I A = X ( i = 1 , . . . , n) or <t T A = A4> T (2) 

where $ = J, 4< = [t|» 1 i|> n ] and A = diag(X 1 , . . . , X n > . For the 

class of matrices which are non-defective, a full linearly independent set 
of eigenvectors always exist and the right and left eigenvectors can be 
normalized such that 

♦ T ¥ = I (3) 

n 

where is an identity matrix of order n. 

Assume that the derivatives of the scalar vector and matrix A 

with respect to a parameter p exist. Taking the partial derivative of Eg. 
(1) with respect to the parameter p and premultiplying the resulting 
T 

equation by $ yields 

4> T L3A/9p]i|K - (9X./3p)e. + A$ T [ 3 i|i /3p] - <t> T C 3ip i /3p = 0 (4) 

T 

where e^= [0 1 0] is a null vector except that the i-th element 

is unity. It is obvious that the coexistence of an eigenvalue and the 
corresponding eigenvector derivatives are required for Eq. (4) to exist. In 
other words, the eigenvalue derivative exists if and only if the 
corresponding eigenvector derivative exists. Let 
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y. = 4> T [ 9A/3p]^ i - OA./3p)e. (5) 

and 

x. = 4- T [ 3^ i /3p] (6) 

Introduction of these two variables into Eq.(4) gives the following linear 
vector equation 

y. + Ax. - x i A i = 0 (7) 

or 

[y ji 3 + [A “ A i I]Cx ji ] = 0 (8) 

in terms of each individual element. 

Assuming that the eigenvalue A^ has a multiplicity r^, i.e. A k (k = i, 

i + 1, i+r^-1) = A ^ , Eq. (8) is satisfied if and only if 

y = 0 for k = i, i+1, i+r.-l (9) 

K 1 i 

with arbitrary x ki to be determined. Let 4^ = [iJk, 4> i + 1 » • • * ’^i+r .-1 3 ’ and 

H' i = L » ijr +1 , ••'’^x + r I 3 re specti vely represent the collection of the 

i 

left and right eigenvectors associated with the repeated eigenvalues A^. 

Since any nonzero combination of eigenvectors associated with a repeated 

eigenvalue is also an eigenvector of the eigenvalue, the column vectors of 

the matrices 4>. and f. respectively span a left eigenspace S and a right 
11 + 1 

eigenspace S for the eigenvalue A ^ . To satisfy Eq. (9), a subset of r^ 

/■S 

independent vectors collected in the n by r^ matrix 4 k should be chosen from 

the eigenspace S x such that 
*i 

4kl3A/3 p ]i|k = (3A i /3p)e. (10) 
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where ^ is a vector chosen from the eigenspace and is an by 1 

null vector except the first element is equal to unity. For a distinct 
eigenvalue r^ = 1, Eq . (10) is automatically satisfied by which the well- 

known equation of the eigenvalue derivative is obtained. 

A 

Observe that, if the vector <|k is also a right eigenvector of the 
matrix [3A/3p], then Eq.(10) is satisfied with the aid of the normalization 
condition in Eq. (3). Let 1 ^ be the right eigenvector of the matrix 


[3A/3p] associated with the eigenvalue ^ such that 


[bA/3p]^^= ; k = 1, ..., m (11) 

The superscript (i) (i-1,2,...) indicates that the corresponding variable is 
associated with the eigenvalue problem of the i-th partial derivative of the 

matrix A with respect to the parameter p. Let r£^ be the number of 


independent eigenvectors ik 


( 1 ) 


( 1 ) 


associated with the eigenvalue , and 


( 1 ) 


be the right eigenspace generated by the r^^ independent eigenvectors 


The eigenvector i|k in Eq. (10) can then be determined from the direct sum of 
intersection subspaces 

i|k e span [S^] (12) 

S = (S £1S^ 1) )0(S sj 1 *) © .. J©(S iisj 15 ) 

i *i ^ *i * 2 *i % 

where Q and © represent the intersection and direct sum of subspaces 
respectively [5]. Note that the direct sum for results from the linear 
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independence of eigenvector subspaces, S^,...,S^ 

♦i 


It follows that the 


dimension, r^ , of the subspace can be written as 


A ® f1\ K ® A /i\ 

r. = 1 dim (S, 11 S]'/) 2 £ r \ i; 
1 k-1 *i *k k-1 lk 


( 13 ) 


The procedures for determining the differentiable eigenvectors 
associated with a repeated eigenvalue can be summarized as follows. 

(1) Compute the eigenvalues A^ , left eigenvectors 4> i , and right eigenvectors 

<1^ of the state matrix A (see Eqs. (1) and (2)). 

(2) Determine the number, r , of independent eigenvectors associated with a 

repeated eigenvalue A ^ , and form the eigenspace S spanned by the 

^i 

eigenvectors. 

(3) Compute the eigenvalues a|^, left eigenvectors <jK^, and right 

eigenvectors of the sensitivity matrix L3A/3p] (see Eq .(11)). 

(4) Determine the number, rf^, of independent eigenvectors associated with 

each eigenvalue A^ 1 ^ and form the eigenspace spanned by the 

*i 

eigenvectors. Note that the dimension of the eigenspace may be 

unity. 

(5) Apply the concept of intersection between two subspaces to determine the 
differentiable eigenvectors associated with the repeated eigenvalue A ^ 

(see Eq.( 12) ) . 
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A ( 1 ) 

(6) Determine the number, r , of independent differentiable eigenvectors 
associated with the repeated eigenvalue A, (see Eq. 03)) • 


(1) "(1) 

The three numbers r. , r.. , and r are related by 

XX XK 


„ "(i) x 0) . "(i) 

r i * r ik and r i “ r ik 


( 14 ) 


Assume that the differentiable vector 41 is in the intersection space 
( 1 ) 

between S and S . . The vector ill. will then be an eigenvector of the state 
*i *k 1 

matrix A as well as the sensitivity matrix [9A/9p]. From the fact that 
explicit formula for eigenvector derivative exists for simple eigenvalues, 


it is suspected that the quantity J may perhaps be computed by taking 

partial derivative of Eq . (11) which is the eigenvalue equation for the 
sensitivity matrix [9A/9p]. 

Based on the above hypothesis, let the matrix A in Eqs. (1) and ( 2 ) be 
replaced by [9A/9pJ and the sensitivity matrix [9A/9p] in Eqs. (4), (5) and 

2 2 

(11) be replaced by [9 A/9p ]. Of course, it is assumed that the above 
derivatives exist. If r^^> 1, perform the above-stated procedures (1) - 

2 2 

( 6 ), using these new matrices [9A/9p] and [9 A/9p ]. We will obtain a 
sub 3 pace 
.( 2 ) 


(s. q sj 1} n sj 2) ) 
1 *1 *£ 


•( 2 ) 


( 15 ) 


of dimension r^ which contains the differentiable eigenvector < 1 ^. In Eq . 

(15), the subscripts and " 5 L" range over the corresponding number of 

invariant eigenvector subspaces so that any other pair of "k" and "A" may 

also be chosen to define sf 2 ^ . If the dimension r| 2 ^ for the subspace S, 2 ^ 

X X 
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2 2 

is still larger than 1, replace the matrix [3A/3p] by the matrix [3 A/3p ] 

2 2 3 3 

and the matrix [3 A/3p ] by [3 A/3p ]. The above-stated procedures (1) to 
(6) can be repeated until a subspace with unit dimension 


s[ k) = (s ft sf^o s^ 2) ft ... ft s[ k) ) 

1 *i * K h \ 


(16) 


(k) (k) 

is obtained such that the dimension r^ of the subspace is also equal 


to unity. Note that there may not exist a solution which satisfies Eq. 
(16). Assume that the solution exists. The differentiable eigenvector ^ 

thus determined will then be the eigenvector of the matrices [S^A/Sp'*] 

0 0 

(j=0,1,2 k) where [3 A/3p ] - A. The derivative [a^/Sp] can then be 

computed by taking partiable derivative of the following eigenvalue problem 
[3 k A/3p k ]J 1 = J i x[ k) (17) 

(k) 

where the eigenvalue is now assumed non-repeated. 


Let $ 3 <(> n ] , 4* * and A 3 diag(A.j,...,A^) be 

respectively the left eigenvectors, right eigenvectors, and eigenvalues of 

k k 

the sensitivity matrix [3 A/3p ]. Assuming that a full linearly independent 
set of eigenvectors exist, the right and left eigenvectors can be normalized 
such that 


. (k)T (k) 
v V 


(18) 


where I is an identity matrix of order n. 

Taking the partial derivative of Eg. (17) with respect to the parameter 


p and premultiplying the resulting equation by <& 


(k)T 


yields 


$ (k)T L3 k+1 A/3p k+1 ]Ji i -(3A i /3p)e i +A (k) $ (k)T [3i i /3p]-<t (k)T [3i i /3p]A i =0 (19) 
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where e^ [0, ... , 1, , 0] is a null vector except that the i-th element 

is unity. Let 

y\ - » (K)T [ S (k * ,) A/ S p (k * 1) ];. - (9X* l /8p)e l (20) 


* (k)T * 

= 4> [3\jK/3p] (21 ) 

Introduction of these two variables into Eq.(19) gives the following linear 
vector equation 

~ ( k ) A A A 

Y 1 + A X. - x.A. - 0 (22) 


[y ji ] * [# - ■ 0 


in terms of each individual element. 


Since the eigenvalue A^ is non-repeated, Eq. (23) yields 

A A /S A 

X ji = y ji / ^ A j " X i^ for j * i 5 j = 1 n (24) 

with arbitrary x^ to be determined, as in reference [4], from the 

A 

normalization of the eigenvector ^ in Eq. (17) such that 

AmA 

= 1 (25) 

Taking partial derivative of Eq. (25) relative to the parameter p yields 


Ar P A A rp A 

L / 9 p ] [3\J>../3p] = 0 
From Eqs . (18) and (21), one obtains 


A C k 1 A 

L3i|) i /3p] = 4» * i 


Substitution of Eq.(27) into Eq.(26) thus yields 


x[t» (k)T o 
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where the elements of associated with the eigenvalues A A^ are computed 

from Eq.(23). The only unknown x ^ in Eq. (28) can thus be determined. 

After the vector 41^ is determined, the first element of Eq. (10) 
produces the following known equality 

OA./3p) = ♦J[3A/3p]* 1 = = A pi (29) 

a 

if the normalization condition (3) is imposed, where 4^ is the right 
eigenvector defined in Eq. (10) which can also be determined in the same 
manner as the left eigenvector ij^. 

Summary: The derivatives of differentiable eigenvectors asso c iated with 
repeated eigenvalues for a general matrix can be computed using the higher 
order derivatives of the matrix if they exist, where a s the corresponding 
eigenvalue derivatives are equal to the eigenvalues of the sensitivity 
matrix [9A/9p]. 


Computation of Differentiable Eigenvectors; 

To compute the intersection of subspaces, the principal angles of the 

subspace pairs in Eq. (12) should be determined (see Ref. 5). Assume, for 

example, that ©^...,0 ... represent the principal angles between subspaces 

r 1 

S, and 1 * whose dimensions satisfy 

*1 *, 


r . 

1 


dim ( S, ) 2 dim 


<s l’ >) 


(D 


> 1 


Compute the singular value decompositions (SVD) 


V 


U.I.V 

l l 


T 

i 


(30) 


(3D 
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subspaces in Eq . (12) can be computed similarly. Assume that the dimension 

( 1 ) ~ 
of the intersection space P S^. (j = 1,...,m) is iTj. Note that ^ as 

defined in Eq . ( 1 3) is the total number of differentiable eigenvectors. 
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EXAMPLE 


Consider a series of three springs and two masses in series as shown in 
Fig. 1. Let k 1 , k 2 and k^ respectively be the first, second, and middle 



k 

m 

Mmwv*- 



k 


2 


aaaawa 



Fig. 1 Three-Spring System 


spring constants. The stiffness matrix for the system is simply 


1 

+ 

3 

-k " 
m 


1 -e 

- k - 

1 

3 

+ 

C\J 

= (k +k ) 
1 m 

**e 1 +2n 


where e * k m / ^ k i +k ra ) and n = (kg-k^^^+k ) (37) 

There are two parameters, namely e and n. involved in Eq.(29). For 
convenience in the subsequent analysis, the following notions are introduced 


A = 

f 1 

_e 1 

9 

[3A/3e] = 


-e 1 +2n 




L 

j 



L3A/3n] = 

0 

% 

0 

and A » 
o 



0 

m 

2 

* 



The matrix A can then be written by 
A = A q + [3A/3e]e + [3A/3n]n 



1 O'! (38) 

I 

(39) 


Instead of directly studying the sensitivity problems of the stiffness 
matrix as shown in Eq. (36), let us examine the three matrices A q , [3A/3e], 
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and [3A/3n]. The matrix A q has repeated eigenvalues A o1 = X o2 = 1 and an 

T T 

eigenspace spanned by 1 ^= [1, 0] and ^ 2 = [0, 1]. 

Case 1 : 

The eigenvalues and eigenvectors of the sensitivity matrix [9A/9e] are 

A e1 = “ 1f *ei“ [1 ’ 1]//2 and X e2 = 1 ’ ^ 2 “ Cl »"^ //2 (40) 

which are obviously in the eigenspace and thus differentiable for the 

perturbed matrix defined by 

A 1= A 0 + C 9A/9e ]e - ” E J (41) 

In fact, and \j)^ 2 are eigenvectors of the matrix A 1 corresponding to two 
distinct eigenvalues 1 +e and X 12 = 1-e. This indicates that the 

eigenvectors and ip £ 2 are not function of the parameter e. The 

eigenvector derivatives for the matrix A 1 are thus zero, which is consistent 
with the theoretical results developed in the preceding section, by simply 
applying [9 2 A/9e 2 ]=0 into Eqs. (20) and (24). 

Case 2 : 

The eigenvalues and eigenvectors of the sentivity matrix [9A/9n] are 

X n 1 = °» *Jr Cl ’ 0] ana X n 2 = 2 ’ [0,1] (42) 

which are the basis vectors for the eigenspace and thus are also 
differentiable for the perturbed matrix defined by 

A_= A + [9A/9nJn = | 1 ° "I (43) 

L° i+2i u 
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Obviously, \j> 


and 1^2 are also the eigenvectors associated with the 
eigenvalues A 21 = 1 and = 1 + 2n of the matrix A 2 no matter what the value n 
is. The eigenvector derivatives are thus zero for the perturbed matrix A 2 
which again verifies the preceding theoretical studies. 

Case 3 : 

Now examine the matrix equation 

A = A 1 + [3A/3n]n (44) 

T T 

where the matrix A has eigenvectors \b ,= [1, 1]//2 and ib = [1,-1]//2 

el Zd 

associated with the eigenvalues A^»1-e and A 12 *1 + e respectively. Since 
eigenvalues A^ and A 12 are distinct, application of Eqs. (5)-(8) yields 

C3i|< e1 /anJ T “[1, -1]/(2e/2) and [3ij, e2 /3n] T =[ 1 , 1]/(2e/2) (45) 

It is seen that [3^ £l /3ri] and C3ip are inversely proportional to the 

parameter e and thus very sensitive in the neigborhood of n = 0, 
particularly when e is sufficiently small. This is due to the fact that, 

T T 

when e = 0, the eigenvectors become i^.|=[1, 03 and 2], corresponding 

to the eigenvalues A 21 = 1 and A 22 = 1 + 2n of the matrix A 2 shown in Eq. 

(36). The eigenvectors of A suffer radical changes with only small 
perturbations in the entries of the matrix A. The eigenvectors and ij> e2 

for all e > 0 are not approximately parallel to either of the two vectors 

i|> , and ib no matter how small the parameter £ is. The transition of the 
nl n2 

eigenvectors ib , and ib - to the vectors ib , and Ui - is possible only when 
el e2 ql r\d 

they are all in the same eigenspace associated with a repeated eigenvalue 
for the case where e = 0. In other words, for any nonzero e no matter how 
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small it is, the transition from the vectors i|/ £l and to the vectors 
and i|»^ 2 becomes impossible. 


CONCLUSIONS 

The existence of diff erentiable eigenvalues and eigenvectors f or a 
general matrix is addressed. The eigenspace which contains the 
differentiable eigenvectors are determined and computed by using the concept 
of subspace intersection in conjunction with the singular value 
decomposition algorithm. The differentiable eigenvectors associated with 
repeated eigenvalues f or a general matrix should simultaneously be the 
eigenvectors of the corresponding sensitivity matrix. Furthermore, the 
derivatives for differentiable eigenvectors associated with repeated 
eigenvalues can be computed from higher order derivatives of the matrix, 
whereas the corresponding eigenvalue derivatives are the eigenvalues of the 
sensitivity matrix. 
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